Non-zero Sum Stochastic Differential Games of Fully 
Coupled Forward- Backward Stochastic Systems 

Maoning Tang 1 Qingxin Meng 1 Yongzheng Sun 2 

O"' 

o 

CN 1 Abstract 

^— > ! 

In this paper, an open-loop two-person non-zero sum stochastic differential game is 
considered for forward-backward stochastic systems. More precisely, the controlled sys- 
£NJ ■ terns are described by a fully coupled nonlinear multi- dimensional forward-backward 

stochastic differential equation driven by a multi-dimensional Brownian motion, one suf- 
ficient (a verification theorem) and one necessary conditions for the existence of open-loop 
Nash equilibrium points for the corresponding two-person non-zero sum stochastic differ- 
ential game are proved. The control domain need to be convex and the admissible controls 
for both players are allowed to appear in both the drift and diffusion of the state equations. 
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vo : 1 Introduction 
O 

Differential Game theory had been an active area of research and a useful tool in many appli- 
cations, particularly in biology and economic. The so called differential games are the ones 
in which the position, being controlled by the players, evolves continuously. On the one 
hand, since the study of differential games was initiated by Isaacs [18], many papers (see 
[U El El El [71 [131 [HI [IS]) have appeared which developed the foundations for two-person zero 
sum differential games. For this case, there a single performance criterion which one player 
tries to minimize and the other tries to maximize. On the other hand, many authors (see 
[ISl [81 [91 HU HH [221 [231 [251 12ZI 1261 [30] discussed N-person non-zero sum differential games. For 
this case, there may be more than two players and each player tries to minimize his individual 
performance criterion, and the sum of all player's criteria is not zero or is it constant. 

All the above mentioned paper are restricted deterministic system. On the differential 
games of stochastic systems, we can refer to [21 [T7J, [29]. In 2008, Tang and Li [28J established 
the minimax principle for N-person differential games governed by forward stochastic systems 
with the control appearing in the diffusion term. In 2010, wang and Yu [31] studied the Non- 
zero sum differential games of backward stochastic systems, and they established a necessary 
condition and a sufficient condition in the form of stochastic maximum principle for open-loop 
Nash equilibrium. 
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Forward-Backward stochastic systems are not only used in mathematical economics (see 
Antonelli pQ, Duffie and Epstein [TO], for example), but also used in mathematical fmance(see 
El Karoui, Peng and Quenez [12] )■ It now becomes more clear that certain important problems 
in mathematical economics and mathematical finance, especially in the optimization problem, 
can be formulated to be Forward-backward stochastic system. So the optimal control problem 
for Forward-backward stochastic system and the corresponding stochastic maximum principle 
are extensively studied in this literature. We refer to (33J [32], [21] and references therein. They 
established the necessary maximum principle in the case the control domain is convex or the 
forward diffusion coefficients can not contain a control variable. In 2010, Yong|34j proved 
necessary conditions for the optimal control of forward-backward stochastic systems where the 
control domain is not assumed to be convex and the control appears in the diffusion coefficient 
of the forward equation. 

In this paper we will discuss non-zero sum stochastic differential games for forward-backward 
stochastic systems. To our best knowledge, very little work has been published on this subject. 
In section 2, we state the problem and our main assumptions. In section 3, we state and prove 
our main results: a sufficient condition for the existence of open-loop Nash equilibrium point 
which can check whether the candidate equilibrium points are optimal or not. Section 4 is 
devoted to present a necessary condition for the existence of open-loop Nash equilibrium point 
by the stochastic maximum principle for the optimal control of the optimal control problem of 
forward-backward stochastic systems established in [32] . 

Moreover, we refer to [21j [20] on the existence and uniqueness of solutions to the fully 
coupled forward-backward stochastic differential equations. 



2 Problem formulation and main assumptions 

Let (Q, J 7 , {J-"i}t>o, P) be a complete probability space, on which a d- dimensional standard 
Brownian motion B(-) is defined with {J"t}t>o being its natural filtration, augmented by all 
P-null sets in J 7 . Let T > be a fixed time horizon. Let E be a Euclidean space. The 
inner product in E is denoted by (■,■), and the norm in E is denoted by | • |. We further 
introduce some other spaces that will be used in the paper. Denote by L 2 (Q, T T , P; E) the 
the set of all E- valued Tt- measurable random variable r\ such that E\r]\ 2 < oo. Denote by 
M 2 (0,T; E) the set of all P-valued J^-adapted stochastic processes {fit) : t e [0, T]} which 
satisfy E J Q T \ip(t)\ 2 dt < oo. Denote by S 2 (0, T; E) the set of all P-valued J-f-adapted continuous 
stochastic processes {(p(t) : t G [0,T]} which satisfy £'sup 0<t<T \ f(t)\ 2 dt < oo. 

In this paper, we consider the system which is given by a controlled fully coupled nonlinear 
forward-backward stochastic differential equations (abbr. FBSDEs) of the form 

dx{t) = b(t,x(t),y(t), z(t),ui(t),U2(t))dt 

+a{t, x(t),y(t), z{t), Ul {t),u 2 {t))dB{t), 

dy(t) = -f(t,x(t),y(t),z(t),ui(t),u 2 (t))dt , , 

+z(t)dB(t), 1 > 

x(0) = a, 

k y(T) = e 

Here b : [0, T] x R n x R m x R mxd x U x x U 2 -»■ R n , a : [0, T] x R n x R m x R mxd x U x x U 2 -> 
R nxd , f : [0, T]x R n x R m x R mxd x U x x U 2 -»■ R m are given mapping, a and T > are given 
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constants, and£ G L 2 (Q, F T) P; R m ). The processes iti(-) and u 2 (-) in the system (12. ip are 
the open-loop control processes which present the controls of the two players, required to have 
values in two given nonempty convex sets U\ C R kl and U 2 C R k2 respectively. The admissible 
control process (ui(-) , u 2 (-)) * s defined as a J-^-adapted process with values in U\ x U 2 such that 

E \ (|'u 1 (t)| 2 + \u 2 {t)\ 2 )dt < +00. The set of all admissible control processes is denoted by 
Jo 

Ax x A 2 . 

For each one of the two player, there is a cost functional 

J i (u 1 (-),u 2 (-)) 

rT 

li(t,x(t),y(t),z(t),u 1 (t),u 2 {t))dt ^ ^ 



E 

+(f>i(x(T)) + hi(y(0)) 



where k : [0, T}x R n x R m x R mxd x U x x U 2 ->• R, fa : iT -»■ f?, ^ : R m R are given mapping 
(2 = 1,2). 

Now we make the main assumptions throughout the paper. 

Assumption 2.1. f,g,o~ are continuously differentiable with respect to (x,y, z,Ui,u 2 ). The 
derivatives of /, g, a are bounded. For any admissible control (ui(-) , u 2 (-)) , the forward-backward 
stochastic system satisfies the assumptions (H2.1) and (H2.2) in Wu[32j. 

Assumption 2.2. fa and hi are continuously differentiable with respect to (x, y, z, ui,u 2 ),x 
and y, (i = 1, 2). And U is bounded byC(l + |x| 2 + |?/| 2 -|-|2;| 2 -|-|wi| 2 -|-|w2| 2 ). And the derivatives 
of U are bounded by C(l + |x| + \y\ + \z\ + \ui\ + \u 2 \). And fa and /ij are bounded by C(l + |x| 2 ) 
and C(l + |y| 2 ) respectively. And the derivatives of fa and hi with respect to x and y are 
bounded by C(l + |x|) and C(l + respectively, (z = 1,2). 



Under Assumption 12. 1[ from Theorem 2.1 in Wu [32J, we see that for any given admissible 
control (ui(-) , u 2 (-) , the system (12.11) admits a unique solution 

(x(.),y(-),*(0) G S£(0,T;iF)x G ^(0,T;iT)x G M|-(0, T; R mxd ). 

Then we call (cc(-), ?/(•), z(-)) the state process corresponding to the control process (ui(-), u 2 {-) 
and ((ui(-), u 2 (-); y(-),q(-), z(-)) the admissible pair. Furthermore, from Assumption 12.21 it is 
easy to check that | Ji(ui(-), u 2 (-))\ < 00.(2 = 1,2). 

Then we can pose the following two-person non-zero sum stochastic differential game prob- 
lem 

Problem 2.1. Find an open-loop admissible control (mi(-), u 2 (-)) G A\ x A 2 such that 



and 



Ji(«i(0,W2(0)= inf Ji( Ul (.), u 2 {-)) (2.3) 

«l(-)6^1 



J 2 (tii(-),^(0)= J 2 (ui(0,«a(0)- (2-4) 

u 2 (-)ev4 2 



Any (ui(-), u 2 (-)) E A\ x A 2 satisfying the above is called a open-loop Nash equilibrium 
point of Problem 12. 1[ Such an admissible control allows two players to play individual optimal 
control strategies simultaneously. 
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3 A Verification Theorem 



In this section we state and prove a verification theorem for the Nash equilibrium points of 
Problem O 

For any given admissible pair (ui(-),u 2 (-);x(-),y(-),z(-)), We can introduce the following 
adjoint forward-backward stochastic differential equations of the system (12. ip 



dk\t) 



+a* y {t, x(t),y(t), z{t), Ul {t):U2{t))<i{t) 
-f* (t, x(t) ,y(t), z(t) , m (t) , u 2 (t) ) U (t) 

+l iy {t, x(t),y(t), z(t), ux(t), u 2 (t)) dt 

b* g (t,x(t),y(t),z(t)Mt),MtW(t) 

+a* z (t, x(t),y(t), z(t), Ul (t), w 2 (t))g i (t) 
-f*(t, x(t), y(t), z(t), Ul (t), u^k^t) 



+liz{t, x(t),y(t), z(t), m(t), u 2 (t)) 



dB(t) 



(3.1] 



dp\t) 



tf(O) 



bl^x^^.zit)^)^))^^) 

+a*(t,x(t),y(t),z(t),u 1 (t),u 2 (t))q i (t) 
-f s (t, x(t),y(t),z(t), Ul (t),u 2 (t))k*(t) 

+l ix (t, x(t),y(t), z(t), ui(t),u 2 (t)) dt 
+q i (t)dB(t) 

-h iy (y ), v\T) = <f) ix (x(T)), 
0<t<T,(i = 1.2). 



Under Assumption ^. 1||2~2"1 according to Theorem 2.2 in [32], the above adjoint equation has 



nxd\ 



ynxd 



X 



a unique solution (k { (■) , p { (■) , q* (■)) e <Sj-(0, T; R m )x G Sjr(0,T; R n )x e M T (0,T;R 
1.2). 

We define the Hamiltonian functions H { : [0, T]xR n xR m x R mxd xU 1 xU 2 xR n xR 1 
R m -»■ R by 

Hi{t,x,y,z,u 1} u 2 ,p } q,k) = (k,-f(t,x,y,z,ui,u 2 ) 

+{p, b(t, x, y, 2, Ui, tt 2 )) + a;, V, z, ui,u 2 ) (3.2) 

+<g, cr(t, x, y, z, u h u 2 )), (i = 1,2). 

Then we can rewrite the equations (13. ip in Hamiltonian system's form: 

dk\t) = -H iy (t,x(t),y(t),z(t), Ul (t), u 2 (t),p i (t),q i (t),k i (t))dt 
-H iz (t, x(t),y(t), z(t), Ul (t), u 2 {t)J{t), q'it), k\t))dB(t) 

dp\t) = -^(t,^)^^),^),^!^),^^),?*^), A;*(*))^ (3-3) 
+q i (t)dB(t) 

[k l (0)= -h iy (y ), p l (T) = cj )lx (x(T)),(i = l,2). 



We are now coming to a verification theorem for an Nash equilibrium point of Problem 12.11 



4 



Theorem 3.1. Under Assumptions \2.1W2.2l let {ui{-), u 2 (-); x(-), y(-),z(-)) be an admissible 
pair. Let {p l {-),q l {-),k l {-))(i = 1,2) be the unique solution of the corresponding adjoint equa- 
tion (13. ip . Suppose that for almost all (t, uS) G [0, T] x Q , (x, y, z, ui) !->■ Hi(t, x, y, z, U\, u 2 (t), 
p 1 ^), q 1 ^), k l (t)) is convex with respect to (x, y, z, ui), (x, y, z, u 2 ) i-> H 2 (t, x, y, z, Ui(t), u 2 ,p 2 (t), 
q 2 (t),k 2 (t)) is convex with respect to (x,y,z,u 2 ), x h^x) is convex with respect with to x, 
and y (->■ 4>i{y) is convex with respect to y (i=l,2), and the following optimality condition holds 



and 



max H x (t, x(t),y(t),z(t), u u u 2 (t) , p 1 (t) , q 1 (t) , k\t)) 

= H 1 (t,x(t),y{t),z(t),u l (t),u 2 (t),p\t)A\t),¥{t)), 



mSiX H 2 (t,x(t),y(t),z(t),u l (t),u 2 ,p (t),q (t),k (t)) 
U2&A2 

= H 2 (t, x(t),y{t), z(t) lUl (t),u 2 (t),p 2 (t),q 2 (t), k 2 (t)). 



(3.4) 



(3.5) 



Then (ui(-) , u 2 (-)) is Nash equilibrium point of Problem \2.1\ 

Proof, (i) we consider an stochastic optimal control problem. The system is the following 
controlled forward-backward stochastic differential equation 



dx(t) = b(t, x(t), y(t), z(t), ui(t), u 2 (t))dt 

+a{t, x(t),y(t), z(t), Ul (t),u 2 (t))dB(t), 
dy(t) = -f(t,x(t),y(t),z(t), Ul (t),u 2 (t))dt 

+z(t)dB(t), 
x(0) = a 

{ y(T) = £, 

where wi(-) is any given admissible control in Ai- The cost function is defined as 

Ji(wi(-),m 2 (-)) 



(3.6) 



E 



T 



h(t, x(t),y(t), z(t),u 1 (t),u 2 (t))dt 

L Jo 

+4> l {x{T)) + h 1 {y ) 



(3.7) 



where (x(-), y(-), z{-)) is the solution to the forward-backward stochastic system (13.61) corre- 
sponding to the control Wi(-) G A\. 

The optimal control problem is minimize J(ui(-), u 2 (-)) over Ui(-) G A±. Now will show the 
admissible control «i(-) is an optimal control of the problem, i.e, 



Ji(ui(-),u 2 (-)) = min Ji(«i(-), u 2 {-)). 

ui(-)eAi 



(3i 



In fact, Let Ui(-) be any admissible control in Ai, (x(-),y(-), z(-)) be the corresponding state 
process of the system (13.61) . It is easy to check that for the control Ui(-), the corresponding 
state process of the system ( 13.61) is indeed (x(-),y(-),z(-)). 
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From (13.71) . we have 



where 



Jx(ui(-),u 2 {-)) - Ji {ui(-), u 2 {-)) 



E 



h(t, x(t),y(t), z(t),u 1 (t),u 2 (t)) 



dt 



+ E 



+ E 



<j>i{x{T)) - 0i(x(T)) 



h(y(0)) - fci(v(°)) 



h + h, 



h = E 



h{t,x{t),y{t),z{t), Ul {t),u 2 (t)) 



h(t, x(t),y(t),z(t),ui(t),u 2 {t)) 



dt, 



h = E 



+ E 



fci(y(0))-/n(y(0)) 



(3.9) 



(3.10) 



(3.11) 



Using Convexity of <pi and hi, and Ito formula to (p 1 (t),x(t) — x(t)) + y(t) — y(t)), 

we get 



I 2 = E[(f>i(x(T)) — (f>i(x(T))] + E[hi(y(0) — hi(y(0))] 
> E(<j> lx {x{T))ix{T)-x{T)) + E(h ly {y a ),y Q -y ) 
= E(p\T)),x{T) - x{T)) + E(h\Q),y Q - y ) 



T 



-E / (H lx {t, x(t),y(t), z(t), tZi(t), u 2 {t),p\t), q\t), k\t)),x(t) - x(t))dt 
- E ! (H ly (t, x(t),y{t),z{t), tZi(t), u 2 (t),p\t), q\t),k\t)),y(t) - y(t))dt 



E / (H lz (t, x(t), y(t),z(t), Mt), u 2 (t),P l (t), Q\t), k\t)), z(t) - z(t))dt 



T 



+ E / {p\t), b{t, x(t),y(t),z(t), Ul (t),u 2 (t)) - bit, x(t),y(t),z(t), rZi(t), S 2 (t)))di 



+ £ / (g x (t), tr(t, x(t), y(t), *(t), Ui(t), u 2 (*)) - a(t, x(t),y(t), z{t),u x {t),u 2 {t)))dt 



+ E / (P(t), -(/(t, x(t), y{t), z(t), u x {t),u 2 {t)) - fit, x{t), yit), z(t), u^t), u 2 it))))dt 



(3.12) 



■Ji + J2, 
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where 



Ji 



E / (H lx (t, x{t),y(t), z{t), tit®, u 2 (t),p\t), q\t), k l {t)),x(t) - x(t))dt 



T 



+ E / (H ly (t, x(t),y(t),z(t), UtWMtlp 1 ®, q l (t),k l (t)),y(t) - y(t))dt 



T 



+ E / (H lz {t, x(t), y(t),z(t), ux(t), u 2 (t),p\t), q\t), k\t)), z(t) - z{t))dt, 



Ji 



E / (p\t), b(t, x(t),y(t),z(t), Ul (t),u 2 (t)) - b(t, x(t),y(t),z(t),ui(t),U2(t)))dt 



T 



+ E / {q\t),(r(t, x(t),y(t), z(t) , Ul (t) , u 2 {t)) - a(t, x(t),y(t), z(t), ^(t), u 2 {t)))dt 



T 

+ E I -(/(t, x(t),y(t),z(t), Ul (t),u 2 (t)) - f(t, x(t),y(t), z(t), u 1 (t),u 2 (t))))dt 

Jo 

and we have used the fact that 

y(T) - y{T) =£-£ = 0, x(0) - x(0) = a - a = 0. 



On the other hand, in view of the definition of Hamilton function Hi (see ( 13. 21) ). the inte- 
gration I\ can be rewritten as 



h 



E 



k(t, x(t),y(t), z(t), ui{t),u 2 (t)) 



h(t,x(t),y{t),z(t)Mt),ih(t)) dt 



E 



H x (t, x(t) ,y(t), z(t) , m (t) , u 2 (t) , p 1 (t) , q 1 (t) , k\t)) 



■H^t, x(t),y(t), z(t), u^t), Mt),?®,?®, k\t)) 



T 



dt 



E / (p^t), b(t, x(t),y(t),z(t), Ul (t),u 2 (t)) - b{t, x(t),y(t),z(t),ui(t),u 2 (t)))dt 



T 



-E / (f(t),a(t, x(t),y(t), z(t), Ul (t), u 2 {t)) - a(t, x(t), y(t), z(t),Mt), u 2 (t)))dt 



T 



-E / (¥(t), -{f{t, x{t),y{t),z{t),u x {t),u 2 {t)) - f(t, x{t),y(t), M*), M*))))** 



J3 — J21 



where 



J*=E 



H^t, x{t),y(t), z(t), Ul (t), u 2 {t),p\t), tit), k\t)) 



H x (t, x(t) ,y{t), z{t) , u, (t) , u 2 (t) , p 1 (t) , q l (t) ,k l (t)) 



(3.13) 



(3.14) 



dt 



From the optimality condition (13.41) . we have 



H lui (t, x(t),y(t),z(t),Mt), Mt),?®^ 1 ®, k\t)), Ul (t) - rZi(t) > > 0, a.s.a.e.. (3.15) 



Using convexity of Hi(t,x,y, z,u 1 ,u 2 (t),p l (t),q 1 (t),k 1 (t)) with respect to (x, y, z, Ui), and 
noting (13.141) and (13. 15j) . we have 



Js >E (Ht^xit),^),^),^^),^)^^^^ 1 ^),^^))^^) -x(t))dt 

T 

+ E [ (H ly (t, x{t),y{t), zMMtlihit^p 1 ®, q l (t),k l (t)),y(t) - y(t))dt 



(3.16) 



+ E 
Jv 



{H lz (t, x(t), y{t), z{t), ux(t), u 2 (t),P\t), q\t),k\t)),z(t) - z(t))dt 



Therefore, it follows from (|53]| . fl3TT2l) . fl3TT3l) and fl3TT6l) that 

J( Ul (-),u 2 (-)) - J(fii(-),t*2(0) =h + h = (J 3 - J2) + h 

> (Ji - J 2 ) + (- Ji + J2) = 0. 

Since tti(-) G *4i is arbitrary, we conclude that 

J 1 (mi(-),w 2 (-)) = min JiM-)iU 2 (-))- 



(3.17) 



(ii) Now we consider another stochastic optimal control problem. The system is the following 
controlled forward-backward stochastic differential equation 



dx(t) = b(t,x(t),y(t), z(t),ui(t),u 2 (t))dt 

+a(t, x(t),y(t), z(t), ui(t),ti2(t))dB(t) 

dy(t) = -f(t,x(t)Mt),<t),Mt)Mt))dt 

+z(t)dB(t) 
x(Q) = a 

{ y{T) = e, 

where u 2 {-) is any given admissible control in A 2 . The cost function is defined as 

J 2 (wi(0,w 2 (-)) 
= E [ Z 2 (*,x(t),y(t),«(t),u 1 (*),M 2 (t))dt 

+0 2 (x(T)) + / i2 ( ? /o) 



(3.18) 



(3.19) 



where (x(-), ?/(•), z(-)) is the solution to the system (13.181) corresponding to the control u 2 {-) G 
A 2 . 

The optimal control problem is minimize J(ui(-),u 2 (-)) over u 2 (-) G A 2 . As in (i), we can 
similarly show the admissible control u 2 {-) is an optimal control of the problem, i.e, 



Ji(ui(-),u 2 (-)) = min Ji(ui(-),u 2 (-)). 

u 2 (-)eA 2 



(3.20) 



So from (13.171) and (13.201) . we can conclude that u 2 (-)) is an equilibrium point of Problem 

12.11 The proof is complete. 

□ 
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4 Necessary optimality conditions 



Theorem 4.1. Under Assumptions \2. i\\2.2\ let (ui(-) , u 2 {-)) be a Nash equilibrium point of 
Problem \2.1[ Suppose that (x(-), y(-), z(-)) is the state process of the system (12. ip corresponding 
to the admissible control (ui(-) , u 2 (-)) ■ Let (p*(-), <f(-), = 1,2) be the unique solution of 

the adjoint equation ( 13. ip corresponding (ui(-),U2(-); x(-),y(-),z(-)). Then we have 

(H lui (t, x(t),y(t),z(t), utit),^),^), q 1 ^), ^(i)),^ - > 0, Vtt! e ^a.s.a.e., 

(4-1) 

(^(i,^),^),^),^^),^^)^^^^ 2 ^)^ 2 ^)),^-^^)) > 0,Vw 2 e C/ 2 ,a.s.a.e.. 

(4.2) 

Proof. Since (ui(*)) ^(O) be an equilibrium point, then 

Ja(u 1 (.),« 2 (0)= min ^i(«i(0,«2(-))- ( 4 -3) 
Mi(-)e^4i 

and 

J 2 («i(-)>'"2(-)) = min ^(^i(-),«2(-))- (4-4) 

M2(-)e-42 

By (14. 3p . Mi(-) can be regarded as an optimal control of the optimal control problem where the 
controlled system is ( 13. 6 j) and the cost functional is (13. 7p . For this case, it is easy to see that 
the Hamilton function is Hi (see (I3.2p ) and the correspond adjoint equation is ( 13. ip for i — 1, 
and (x(-), y(-), l(-)) is the corresponding optimal state process. Thus applying the stochastic 
maximum principle for the optimal control of the forward-backward stochastic system (see 
Theorem 3.3 in [32J), we can obtain ( I4.ip . Similarly, from ( I4.4p . we can obtain (14. 2p . The proof 
is complete. 

5 Conclution 

In this paper, we have discussed two-person non-zero sum differential game governed by a 
fully coupled forward-backward stochastic system with the control process u(-) appearing in 
the forward diffusion term. The verification theory is obtained as a sufficient condition for 
the existence of open- loop Nash equilibrium point. On the other hand, applying the stochastic 
maximum principle for the optimal control problem of the forward-backward stochastic system, 
we derive the the stochastic maximum principle in a local formulation as a necessary condition 
for the existence of open- loop Nash equilibrium point. 

□ 

References 

[1] F. Antonelli. Backward-forward stochastic differential equations. Ann. Appl. Probab., 
3:777-793, 1993. 

[2] T. basar and S. Li. In Proceedings of IFAC 10th Word Congress, pages 231-236. 



9 



[3] L. D. Berkovitz. A differential games without pure strategies solutions on an open set, 
advances in game theory. In Annuals of Mathematica Studies, number 52, pages 174-194. 
Princeton University Press, Providence, New Jersey, 1964. 

[4] L. D. Berkovitz. A variational approach to differential games, advances in game theory. In 
Annuals of Mathematica Studies, number 52, pages 127-174. Princeton University Press, 
Providence, New Jersey, 1964. 

[5] L. D. Berkovitz. Necessary conditions for optimal strategies in a class of differential games 
and control problems. SIAM J. Control Optim., 5:1-24, 1967. 

[6] L. D. Berkovitz. A Survey of Differential Games. Mathematical Theory of Control. Aca- 
demic Press, 1967. 

[7] L. D. Berkovitz. The existence of value and saddle point in games of fixed duration. SIAM 
J. Control Optim., 23:173-196, 1985. 

[8] J. H. Case. Toward a theory of many-player differential games. SIAM J. Control Optim., 
7:179-197, 1969. 

[9] G. Chen and Q. Zheng. N-person differential games, part 1-3. Mathematial Research 
reports, Pennsylvania State University, 1984. 

[10] D. Duffie and L. Epstein. Asset pricing with stochastic differential utilities. Rev. Financial 
Stud., 5:411-436, 1992. 

[11] T. Eisele. Nonexistence and nonuniqueness of open-loop equilibrium in linear-quadratic 
differential games. Journal of Optimization Theory and Applications, 37:443-468, 1982. 

[12] N. El Karoui, S. Peng, and M. C. Quenez. Backward stochastic differential equations in 
finance. Math. Finance, 7:1-71, 1997. 

[13] R. J. Elliott and N. J. Kalton. The existence of value in differential games. Memories of 
the Amercian mathematical Society, 126:1-67, 1972. 

[14] W. H. Flemming. the convergence prblem for differential games. Journal of Mathematical 
Analysis and Applications, 3:102-116, 1961. 

[15] W. H. Flemming. The convergence problem for differential games, part 2, advances in 
games theory. In Annuals of Mathematica Studies, number 52, pages 195-210. Princeton 
University Press, Providence, New Jersey, 1964. 

[16] A. Friedman. Linear-quadratic differential games with nonzero sum and n-players. Journal 
of Rational Mechanics and Analysis, 34:165-178, 1969. 

[17] A. Friedman. Stochastic differential games. J. Differential Equations, 11:79-108, 1972. 

[18] R. Isaacs. Differential games, parts 1-4. The RAND Corporation, Research Memorandums, 
pages Nos. RM-1391, RM-1399, RM-1411, RM-1486,, 1954-55. 

[19] D. L. Lukes and D. L. Russell. A global theory for linear-quadratic differential games. 
Journal of Mathematical Analysis and Applications, 33:96-123, 1971. 



10 



[20] J. Ma and J. Yong. On linear, degenerate backward stochastic partial differential equations. 
Probab. Theory Relat. Fields, 1 13: f 35-170, 1999. 

[21] S. Peng and Z. Wu. Fully coupled forward-backward stochastic differential equations and 
applications to optimal control. SIAM J. Control Optim., 37:825-843, 1999. 

[22] I. G. Sarma and U. R. Prasad. A note on the necessary conditions for optimal strategies in 
a class of noncoperative n-person differential games. SIAM J. Control. Optim., 9:441-445, 
1971. 

[23] I. G. Sarma, R. K. Ragade, and U. R. Prasad. Necessary conditions for optimal strategies in 
a class of noncoperative n-person differential games. SIAM J. Control. Optim., 7:637-644, 
1969. 

[24] J. Shi and Z. Wu. The maximum principle for fully coupled forward backward stochastic 
control system. Acta Automat Sinica, 32:375-380, 2006. 

[25] A. W. Starr. Nonzero-sum differential games: Concepts and models,. Harvard University, 
Engineering and Applied Physics, Technical Report, (590), 1969. 

[26] A. W. Starr and Y. C. Ho. Further properties of nonzero-sum differential games. Journal 
of Optimization Theory and Applications, 3:207-219, 1969. 

[27] A. W. Starr and Y. C. Ho. Nonzero-sum differential games. Journal of Optimization 
Theory and Application, 3:184-206, 1969. 

[28] S. Tang and X. Li. Differential games of n players in stochastic systems with controlled 
diffusion terms. Automation and Remote Control, 69:874-890, 2008. 

[29] K. Uchida. On existence of a nash equilibrium point in n-person nonzero sum stochastic 
differential games. SIAM J. Control Optim., 16, 1978. 

[30] P. Varaiya. N-person nonzero-sum differential games with linear dynamics. SIAM J. 
Control Optim., 8:441-449, 1970. 

[31] G. Wang and Z. Yu. A pontryagin's maximum principle for non-zero sum differential games 
of bsdes with applications. IEEE Transactions on Automatic Control, 55:1742-1747, 2010. 

[32] Z. Wu. Maximum principle for optimal control problem of fully coupled forward-backward 
stochastic systems. Acta Math. Appl. Sinica (English Ser.), 11:249-259, 1998. 

[33] W. Xu. Stochastic maximum principle for optimal control problem of forward and back- 
ward system. J. Aust. Math., 37:172-185, 1995. 

[34] J. Yong. Optimality variational principle for controlled forward-backward stochastic differ- 
ential equations with mixed initial-terminal conditions. SIAM J. Control Optim., 48:4119- 
4156, 2010. 



11 



